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ABSTRACT 


Statistical analysis provides a powerful tool for modern 
decision makers. Unfortunately, this tool can be a two-edged 
sword. Improper or erroneous analysis can result in incorrect 
and costly decisions. Many analysis errors can be traced to 
the misapplication of statistical methods. 

When examining experimental data, it is first necessary to 
determine the true nature of that data, specifically, the 
structure from which the data is drawn. This determination 
will then be a primary factor in the choice of statistical 
tests, 

This thesis examines an analysis performed by Surface 
Warfare Development Group (SWDG). The SWDG analysis is shown 
to be incorrect due to the misapplication of testing methods. 
A THEE analysis 1S presented and recommendations 
suggested for changes to the testing procedures used by SWDG. 
Additionally, a computer program to perform basic Analysis of 
Variance (ANOVA) tests is provided to be appended to the 


current SWDG statistical software. 


PX 


THESIS DISCLAIMER 


The reader is cautioned that computer programs developed 
in this research may not have been exercised for all cases of 
interest. While effort has been made, within the time 
available, to ensure that the program are free of 
computational and logic errors, they cannot be considered 
validated. Any application of these programs without 


additional verification is at the risk of the user. 
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I. BACKGROUND 


A. ORGANIZATION 

Surface Warfare Development Group (SWDG) is responsible 
for the Ship ASW Readiness/Effectiveness Measuring Program 
(SHAREM), a Chief of Naval Operations sponsored effort 
established in 1969 to quantitatively assess the antisubmarine 
warfare (ASW) performance of surface ships. This program was 
expanded in 1973 to include surface ASW tactics. SWDG 
conducts several large-scale ASW exercises called SHAREMs each 
year in order to gather data on ship, submarine, and weapons 
system performance. These exercises are conducted in various 
regions throughout the world, typically involve seven to ten 
combatant platforms and supporting aircraft, and extend for 
seven to fourteen days. Data is gathered on all involved 
platforms to be later collated and processed by SWDG. The 
goals of the SHAREM program are met through the design, 
conduct, reconstruction, and analysis of at-sea exercise data. 


(Ref. l:p. 1)] 


B. DATA ANALYSIS 

SWDG uses a statistical package created on-site to perform 
analyses on SHAREM exercise data. This package is designed to 
be used by personnel who are not generally familiar with 
advanced statistical tests. The SWDG package is not complete, 


1 


however. Tests such as Analysis of Variance (ANOVA) are being 
performed by hand by senior analysts. SWDG wishes to add an 


ANOVA module to its statistical package. 


C. WEAPON SYSTEM 

The weapon system examined herein is a real-world system 
that will be referred to as XYZ, to keep this treatment 
unclassified at the request of SWDG. SWDG, in conjunction 
with Operational Test and Evaluation Force  (OPTEVFOR), 
performed an analysis of the factors affecting the performance 
of this system in early 1992. The original SWDG analysis is 
classified Top Secret and was released only to those agencies 
considering XYZ for procurement. In fact, the SWDG analysis 
was a contributing factor in the decision to proceed with XYZ 


procurement. 


D. PROBLEM OVERVIEW 

System XYZ was tested over a period of nine months, using 
different platforms and several geographical areas. From the 
raw data, SWDG eliminated those trials in which there was a 
mechanical failure of the weapon, interference from platforms 
not associated with the trial, breakdown of the data recording 
equipment, or incomplete data compilation. From the original 
190 trials, 89 were considered usable for analysis purposes. 
These trials are assumed to be independent. In fact, they may 
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not be; however, the data as tabulated before analysis gives 
no indication of being correlated. Data resolution was such 
that four factors that might have an effect on XYZ performance 
could be examined. These factors will hereafter be referred 
toas A, B, C, and D for classification purposes as previously 
discussed. Additionally, each of these factors could 
inherently be broken down into two levels, high and low. 
Finally, the test result (decision variable) was documented as 
weapon success or weapon failure. A weapon was considered 
successful only if it impacted the target; otherwise, it was 
considered a failure. A breakdown of the analysis data is 


found in Table 1. 


TABLE 1: COMPILATION OF ANALYSIS DATA 


SUCCESSES 
FAILURES 
HI NE Ὁ 
C LOW D 
LOW HI D 
€ LOW D 





Several details are of immediate note. First, there is no 
data available for the factor combination of high A/high B. 
No explanation is given for the absence of this data, although 


1t is conceivable that SWDG or OPTEVFOR considered this 


combination as tactically infeasible. Secondly, there is an 
unequal number of replications of each factor combination for 
which there is data. Two combinatıons have only three 
associated trials, while one has fourteen trials. Finally? 
there are factor combinations with no successes, only 
failures. These details must be taken into account in order 


to properly perform analysis. 


E. PURPOSE 

This thesis proposes that the analysis performed by SWDG 
on the factors affecting system XYZ is flawed and offers a 
corrected analysis. Additionally, an interim ANOVA program is 


included that can be added to the current SWDG package. 


II. SWDG ANALYSIS 


A. ANALYSIS APPROACH 

The analysts at SWDG viewed this problem as a 2! factorial 
Analysis of Variance (ANOVA) problem. There are 16 possible 
combinations of factor levels in this approach. To determine 
the value associated with each combination, a weapon success 
was given a value of ten and a weapon failure a zero. Each 


cell value was then calculated by 


Cell Value s l0 x number of successes within cell 


---- i (2.1) 
number of weapons fired within cell 
Those cells without data were given a value of zero. Given 
these values, ANOVA calculations were made with the 


probability of Type I error equal to 0.05. It was assumed 
that the higher order interactions (third and fourth order) 
were not significant. These values were pooled with sampling 
error to estimate the residual effect. The results are 
displayed in Table 2. 

As shown, the SWDG analysis found that main effect D and 
the BD interaction are significant at the 0.05 level, which 15 


the SWDG standard for Type I error.[Ref. l:p. 3] 


TABLE 2: ANALYSIS OF VARIANCE 
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SOURCE 
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3X/4X & το M 09472 2/0525 
ERROR 


*Significant with «20.05 





B. ANOVA REVIEW 

ANOVA is used to test hypotheses about the equality of 
means of samples from three or more normal populations. [Ref. 
2:p. 492] The ANOVA procedure determines whether the 
discrepancies between the sample means are greater than could 
reasonably be expected from the variation that occurs within 
the sample classification.[Ref. 3:p 167] It 1s important to 
recognize that the ANOVA procedure requires independent 
samples from normal populations in order to produce correct 


results. 


C. CRITIQUE OF SWDG ANALYSIS 

In reviewing the SWDG analysis, it was noted that this 
problem was not a "standard" 2! factorial ANOVA design as SWDG 
claimed. It is, in fact, a 3/4 replication of a 2! factorial 
arrangement with unequal sample sizes. In order to make the 
observed data fit the 2! factorial form, SWDG used zeroes for 
the cells with no observations. There is no acceptable 
rationale for this procedure. 

Additionally, successes were valued as tens and failures 
as zeroes. These values cannot be viewed as random variables 
from a normal population. They are more accuratel y described 
as the results of a binomial experiment consisting of n = 89 
independent Bernoulli trials with probability of success p. 


The value of p can be estimated by 


p= number of successes 


2 
number of trials 2 


Application of the central limit theorem reveals that 
given a "large" number of trials, the distribution of the 
results of this experiment is approximately normal. 

(Ref. 2:p. 294] The question remains as to whether 89 trials 
is sufficiently large to justify the application of the ANOVA 


procedure. For these reasons, other statistical methods 


should be explored. 


III. ALTERNATIVE ANALYSIS 


A. CATEGORICAL DATA ANALYSIS 

Statistical methodology for categorical data analysis 
traces its roots to the work of Francis Galton in the 1880's 
on regression methods for continuous variables. The early 
literature on categorical data analysis dealt primarily with 
how to measure association. M. H. Doolittle's paper in 1887 
on the subject contained the following quote: 

Having given the number of instances respectively in 
which things are both thus and so, in which they are thus 
but not so, in which they are so but not thus, and in 
which they are neither thus nor so, it is required to 
eliminate the general quantitative relativity inhering in 
the mere thingness of the things, and to determine the 
special quantitative relativity subsisting between the 
thusness and the soness of the things.[Ref. 4:p. 28] 

Karl Pearson and  G. Udny Yule made significant 
contributions to the study of association between categorical 
variables at the turn of the twentieth century. Although they 
differed in opinion regarding continuous distributions 


underlying the data structures, their work laid the groundwork 


for modern categorical analysis.[Ref. 4:p. 26-7] 


B. PEARSON CHI-SQUARED TEST 
In 1900, Pearson was examining various gambling games in 


Monte Carlo. Through the process of analyzing whether 


possible outcomes on a roulette wheel were equally likely, he 
proposed the test statistic 


= 2 
ee ye | (3.1) 


is the expected cell frequency for cell i, n, is the 


where m: i 


i 
observed cell count, and N is the total number of cells. 
(Ref. 4:p. 43] For large samples, this statistic approximates 


a chi-squared distribution with N - 1 degrees of freedom. 


C. CONTINGENCY TABLES 
Table 3 is a representation of factor A from the XYZ 
system data in the format commensurate with categorical data 


analysis. 


TABLE 3: FACTOR A BREAKDOWN 


EFFECT SUCCESSES FAILURES 
πεις 


πα. 
LOW A 272 
TOTAL | 30 Ἢ 





Tables of this form, with each cell containing the 
frequency count of the outcome, are called contingency tables, 


a term introduced by Pearson in 1904.[Ref. 4:p. 9] This is an 


example of a two-way contingency table, because there are two 
categorical response variables with number of levels I = 2 and 


J 


2, respectively. 


D. ANALYSIS OF SYSTEM XYZ 
1. Modification of Pearson statistic 
Statistical independence of the categories can be 
examined through a modification of Pearson's original test. 


First, expected cell frequencies are estimated by 


me Total; x Total ; | (3.2) 


17 n 


The Pearson chi-squared statistic can then be calculated as 


(My - My) 
PA πο ο. i" 


Pearson stated that x! approximated a chi-squared 
distribution with IJ - 1 degrees of freedom.[Ref. 4:p. 43] 
This was disputed in 1922 by R. A. Fisher, who proved that the 


correct degrees of freedom is 


GE (IJI AED AJ Sr eae (3.4) 


Fisher's result will be used in this analysis.[Ref. 5:p. 213] 
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TABLE 4: CONTINGENCY TABLE WITH PEARSON STATISTICS 


a a I du. e —— — 


MAIN EFFECT SUCCESS FAILURE 


0.720 1202787. 10.366 Dp 
HIGH A 
24 





0.404 19.213 10205 21.737 


LOW A 


TOTAL 


2. Presentation of values 
The standard format for the presentation of these 
calculations is shown in Table 4. The estimated cell value πι. 
is inserted in the top right corner of the cell and the 
individual cell contribution to the Pearson statistic is 


placed in the top left corner. 


3. Main Effects 
The Pearson statistic can be used to test the 
hypothesis that there is no relationship between the 
variables. In the examination of the main effects of XYZ, 
this translates into a test of the relationship between the 
different effect levels. As the data is presented in a two- 
way contingency table with two levels per variable, the 


corresponding Pearson chi-square statistic has 


(2 - 1) (2 - 1) = 1 degree of freedom. (2:59) 


τι 


Using the SWDG standard of 0.05 for TYPE I error, the 


appropriate chi-square quantile is 


= Bea (376 


Therefore, 1f the Pearson statistic calculated for 
each of the main effects is greater than 3.841, there is a 
significant difference in the variables due to the level of 
the effect. For example, using the values from Table 4, the 


Pearson statistic for main effect A 1s 


X? = 0.720+0.404+0.366+0.205 = 1.695 . (3-183 


Since 1.695 is less than 3.841, the hypothesis of 
independence cannot be rejected. Main effect A, therefore, is 
not significant at the 0.05 level. Table 5 is a summary of 
the results of the examination of the main effects. The 
contingency tables for all main effects are found in 


Appendix A. 


TABLE 5: MAIN EFFECTS SUMMARY 


EFFECT SIGNIFICANCE 
1.695 Not significant 











0.008 Not significant 


C i eee lee Not significant 


> jes 


Probability of Type I error = 0.05 


T2 


In the examination of the main effects, it appears 
that Pearson's chi-square test and ANOVA yield the same 
result. Only main effect D is significant at the 0.05 level. 
Table 6 provides a comparison of the results. Although there 
is also a similar ordering of the effects with regard to the 
magnitude of the test statistics, this does not provide 
justification for the use of the ANOVA procedure. This will 


be borne out in the analysis of the interactive effects. 


TABLE 6: ANOVA-PEARSON COMPARISON 


ANOVA PEARSON 
EFFECT | 
SIGNIFICANCE | SIGNIFICANCE 


| s | oos | ποιοῖς. | 0.008 
la | 1.07 |  Netsig. | 1.695 
Le orae | not sig. | 1.714) not sig. 


6.29 STORM” 5.822 M SIgnibe 












Probability of Type I error = 0.05 


4. Interactive Effects 

Calculation of interactive effects using Pearson's 
Statistic are somewhat less straightforward. The data is 
first broken down to reflect effect combinations, as shown in 
Table 7. 

If the Pearson statistic was calculated at this point, 
the resulting value would not measure the interactive effect. 
It would test the independence of the four combinations versus 


success and failure, and would have 3 degrees of freedom. 


ÉS 


These three degrees of freedom include the two main effects 
and the interactive effect. The interactive effect must be 


isolated. 


TABLE 7: AC INTERACTION FIRST 5‘ FIRST STAGE 


| mamre | a. [| 19 — 
| mrauoc | 7 [| 246 
| zo auc | 3i | m 
LZ 0 
dal Cid 









LOW A/LOW C 
TOTAL 


In order to find the interactive effect, it is useful 


to examine the different levels as contrasting coefficients. 


Let '*' denote a high level effect, and '-' a low level 
effect. This translates into a coefficient table, such as 
Table 8. 


TABLE 8: TABLE OF COEFFICIENTS 
























15t COEFF 20d COEFF PRODUCT 
MAIN EFFECT | MAIN EFFECT AC 
INTERACTION 






LOW A/HI C 


l4 


If the rows with a positive first factor effect, in 
this case one and two, were combined, and if the "negative" 
first factor rows were combined, the resulting table is the 
same as the contingency table for main effect A. Similarly, 
if the positive second factor rows were merged, as well as the 
negative second factor rows, the resulting table would 
represent main effect C. 

The product column of the table of coefficients is the 
result of multiplying the two factor columns. It would be 
reasonable, therefore, to combine the positive and negative 
rows of the product column to determine the interaction 


between the two factors. Table 9 reflects this merger. 


TABLE 9: AC INTERACTION SECOND STAGE 


EFFECT SUCCESSES FAILURES TOTAL | 
|| HI A/HI C | 
LOW A/LOW C | 
| HI A/LOW C | 
LOW A/HI A 


Ro — — 














The Pearson chi-squared test 1S now applied. Again, 


the resulting test statistics are compared to a chi-square 
distribution with one degree of freedom at the 0.05 level. A 
summary of the results is found in Table 10. The contingency 
tables for all two-way interactive effects are found in 


Appendix B. 


i 


TABLE 10: INTERACTIVE EFFECTS SUMMARY 


(EFFECT | x? | SIGNIFICANCE | 
ES A 6,079 orgnat. 

an f sos | signif. | 
| sp | 5.54] βίφαιε. 


Probability of Type I error = 0.05 








The AB interaction deserves special attention, because 
the high A/high B effect combination has no associated data. 
Consequently, there is no way to make a good approximation of 
the AB interaction. The methodology used for the other two- 
way interactions may not yield correct solutions when applied 
in this case, due to the loss of a degree of freedom. The 


three effect combinations are examined in Table ll, giving 


1-120157 (2 df) (555. 


The two degrees of freedom for this value represent a mixture 
of the single degrees of freedom for A, B, and AB. When 2.45 


is compared with the sum of the chi-square values for A and B, 


è 


1.695 + 0.008 = 1.703, (CIÓN 


it appears that the AB interaction is not a significant 


effect. 
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TABLE 11: AB COMBINATIONS 


EFFECTS SUCCESSES FATLURES 


HI A/LOW B 057.20 10.787 |0.366 2159273 
8 24 
3 
2 



















3 
LOW A/HI B 9. og πλ Jo QU 230202 
3 
12 2 
LOW A/LOW B 0901 7.416 |0.458 14.584 
I 


TOTAL ales 


X? = 0.720+0.003+0.901+0.366+0.002+0.458 = 2.45 


2 
5 
22 





As with the main effects, the results of the Pearson 
test on interactions can be compared to the SWDG ANOVA 


results. This comparison is made in Table 12. 


TABLE 12: ANOVA-PEARSON COMPARISON (INTERACTIONS) τ 






EFFECT ANOVA PEARSON" ç 


| 
era Z 


m | 2.18 |  Notsig. | 4.098 | significant 


AC 1079) Not sig. | 0.946 Not sig. 


BD 






5.4 Srgnifticant 5.504 BIGNIEECanE 


0.483 


Probabllity of Type I error = 0.05 






TJ 


The Pearson chi-squared test reveals that three 
interactive effects, AC, AD, and BD, are significant at the 


0.05 level. ANOVA shows only BD as being significant. 
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IV. CONCLUSIONS AND RECOMMENDATIONS 


A. COMPARISON OF TESTS 

The ANOVA procedure is not the best choice of methods to 
apply to the XYZ system data. The data is somewhat unwieldy; 
the unequal number of trials per effect combination, cells 
with a very small number of trials, and cells with no trials 
are significant problems. The use of zeroes in the latter 
case to fill out the 2% factorial design is a major error. 
Furthermore, the ANOVA procedure is premised upon continuous 
response variables, whereas the data in this case is discrete. 

SWDG’s calculations employ formulas which assume equal 
sample sizes. They are not correct for the unequal cell-sized 
problem presented herein and are another factor to be 
considered when accounting for the discrepancies in the 
results of the two tests. 

Contingency tables may be a better analytical tool to 
apply to count data such as for system XYZ. The Pearson 
statistic associated with contingency tables reveals two 
significant interactions that are missed by ANOVA, the AC and 
AD interactions. The small sample size and the improper 
formula application previously addressed are the primary cause 
of these omissions. Table 13 is a compilation of the results 
of both tests. 

It is not overly surprising that the use of contingency 


tables was overlooked in the analysis of this problen. 
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TABLE 13: COMPILATION OF RESULTS 


SIGNIFICANCE 


ANOVA PEARSON TEST 

| CONT. TABLES 
Not significant Not significant 
Not significant | Not significant 


Not significant Not significant 
SIGNIFICANT SIGNIFICANT 


Not significant 
| 


Not significant | ------ || 





Not significant Not significant 


Probability of Type I error = 0.05 


Outside of Pearson”s work, there was very little work done in 
the refinement of this form of statistical methodology until 
the last thirty years.[Ref. 4:p. 1) ANOVA received the 
majority of the attention through the first half of the 

of the twentieth century, and it has become the method of 
choice for many analysts. Although it is a powerful tool, it 


must be used in the proper context. 


B. DESIGN OF EXPERIMENT 
In retrospect, it is easy to say that the design of this 
experiment has a few problems, if in fact there was a design. 


There did not appear to be an effort taken to balance the 
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number of trials conducted for each effect combination. For 
completeness, trials should have been purposely done for all 
sixteen combinations. It is recognized that it is difficult 
in an open ocean environment to coordinate air, surface, and 
subsurface units in such a way as to adequately reproduce 
specific trials, and there may be physical limitations to 
possible effect combinations. 

The first and perhaps most important criteria to consider 
when designing an experiment is the response variable. Toa 
great extent, weapon systems provide a discrete response: hit 
or miss, success or failure. A continuous response variable 
associated with weapon systems is miss distance. Miss 
distance may be difficult to measure for many systems, but it 
can often be estimated. If the miss distances had been 
recorded for system XYZ, the resulting distribution could 
possibly have been normalized, setting the stage for the use 
of ANOVA. 

More importantly, if miss distances can be recorded, 
fractional factorial experiments can be employed. A 
fractional factorial experimental design would necessitate a 
considerably smaller number of required trials, thereby 
generating a considerable savings in time and money. For 
example, the full 2* factorial design requires (16 * n) runs, 
where n is the number of desired replications. A2: 
fractional factorial design, or half-fraction design, would 


require only (8 * n) trials.(Ref. 3:p. 378] Table 14 
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describes the trials required to meet the conditions of a 


half-fraction with resolution IV. 


TABLE 14:  HALF-FRACTION DESIGN 


LEVEL AND EFFECT COMBINATIONS 


Low A, Low B, Low C, Low D 
Hi A, Low B, Low C, Hi 
Low A, Hi B, Low C, Hi 
Hi A, Hi B, Low C, Low 
Low A, Low B, Hi C, Hi 
Hi A, Low B, Hi C, Low 
Low A, Hi B, Hi C, Low 
Hi A, Hi B, Hi C, Hi D 





1. 
2. 
3. 
4. 
Ds 
6. 
7. 
8 


It must be noted that fractional designs appear to give 
the user "something for nothing"; that is, no loss of 
information with fewer number of trials. This is not entirely 
true. The price paid for using the fractional design is the 
confounding or confusing of effects.[Ref. 3:p. 381] However, 
with the proper designs and the previously stated assumption 
of insignificant higher-order interactions, this penalty is 
negligible. With shrinking budgets and weapons increasing in 
complexity and cost, it is imperative that testing procedures 


be as efficient as possible to minimize expenditures. 


22 


V. ANOVA PROGRAM 


A. CONSTRUCT 

The ANOVA program found in Appendix C was created to be 
appended to the existing SWDG computerized statistical 
package. It is written in Borland C++ and is constructed to 
be user friendly, although a basic understanding of the 
precepts of ANOVA testing is required. This program allows 
the user to choose the desired test and significance level, 
prompts the user for data input, performs the necessary ANOVA 
calculations, and presents the results in tabular form. Table 
look-ups are eliminated as this program calculates the 
appropriate F statistic quantiles as required for significance 
testing. The ANOVA tests provided are restricted in scope, as 
this program is intended as only an interim analytical aid 
until a sophisticated statistical package meeting SWDG's needs 


can be procured. 


B. CAPABILITIES 
This program performs ANOVA calculations for the following 
tests: One-way ANOVA, Two-way ANOVA, and 2' factorial ANOVA 


With k <= 5. 
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C. METHODOLOGY 
1. Models 

ANOVA is used to test hypotheses about the equality of 
means of two or more normal populations, using sample data 
drawn from these populations. The simplest models assume that 
each data observation can be expressed as a sum of a mean 
value, a value or values attributed to effects, and a term for 
sampling error. These models are referred to as completely 
randomized models. The ANOVA procedures used herein are based 
on these models. 

a. One-way ANOVA 


The model for one-way ANOVA is 


Vie eG TENE (SEA 


where Yi; are the observed values for the experiment, mu is the 
overall mean of the data, theta is the average deviation for 
each 1, and ej, are normally distributed and independent errors 
of observation.[Ref 2:p. 495] It is not necessary for there 
to be an equal number of observations from each population. 
The test will determine 1f there is a significant difference 
between the means of the populations. 


b. Two-way ANOVA 


The model for two-way ANOVA is 


ar or Tee DERE se (SB 


24 


This randomized block model uses the same 
variables as the one-way model, with the addition of a 
variable Bj to represent the expected deviation caused by an 
extraneous condition. [Ref. 2:p. 499] For this design, an 
equal number of observations are required from each 
population. Additionally, this model assumes no interaction 
effect between the populations and the extraneous condition. 
The removal of the variability of the outside factor gives a 
more sensitive test for the equality of the population means, 
while at the same time testing that the outside factor is 
equally applied to each population.[Ref. 2:p. 503-4] 

c. 2! Factorial ANOVA 

2* factorial designs examine the effects of 
multiple factors, each at two levels, on a continuous, 
normally distributed response variable. Yates" algorithm is 
utilized as the computational method. This algorithm provides 
a rapid calculation of effects using a standard ordering of 
the data.[Ref. 3:p. 342] Yates' algorithm estimates 
significance of main effects and interactions. Equal numbers 


of replications are required for this program, and there must 


be data for every factor combination. This application is 
limited to the examination of k = 5 factors and 20 
replications per cell. The data must be placed into standard 


order when input to the program. 


ο. E Statistic 
The F statistic used by this program is derived from 
an APL program created by Professor H. J. Larson at the Naval 
Postgraduate School, which is based on a method created by A. 
H. Carter in 1947[Ref. 6:p. 352-7]. The program eliminates 
the need for table look-ups by calculating the appropriate F 


distribution quantile. 
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EFFECT 


LOW A 


TOTAL 


EFFECT 


APPENDIX A: MAIN EFFECTS 


TABLE A-1: MAIN EFFECT A 


SUCCESSES FAILURES 


πο δι 212213 
8 


OS s 23.202 





Q = .720+.404+.366+.205 = 1.695 


TABLE A-2: MAIN EFFECT B 


SUCCESSES FAILURES TOTAL 


.003 ES 2325202 a 





27 


TABLE A-3: MAIN EFFECT C 


EFFECT SUCCESSES FAILURES TOTAL 
HI C 1876 2 5 A 23.8085 
36 
rS τη 
LOW C . 460 1955 12:34 SOS 
55 
15 38 
TOTAL 30 


Q = .676+.460+.344+.234 = 1.714 









TABLE A-4: MAIN EFFECT D 


EFFECT SUCCESSES 


HI D 2.432 172928 
μα 


LOW D 3.417 12.472 
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TOTAL 30 


(4 2,232 3.417€ 1.236 1.737 = 8:822 
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APPENDIX B: INTERACTIVE EFFECTS 


TABLE B-l: AC INTERACTION 


EFFECT SUCCESSES FAILURES TOTAL 


HI A/HI C 22085 14.494 | 1.059 282506 
LOW A/LOW C 






| 















HI A/LOW C 
LOW A/HI C 


© = 2.083 71.947 +2.059+.990 - 6.079 


TABLE B-2: AD INTERACTION 


EFEECT SUCCESSES FAILURES TOTAL | 


HI A/HI D Ba OO 28.506 | 
LOW A/LOW D | 
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HI A/LOW D 0.666 30.494 


LOW A/HI D 
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Q-1.401*1.309-*.712*.666 = 4.088 


2 


TABLE B-3: BC INTERACTION 


EFFECTS SUCCESSES FAILURES TOTAL 


HI B/HI C Oi LAOS ο 161 22,555 
LOW B/LOW C 44 

17 27 
025.10 15.169 [07158 2937831 
45 
13 32 


ae | 59. M 


Q = .317+.310+.161+.158 = 0.946 
















HI B/LOW C 
LOW B/HI C 


7 TABLE B-4: BD INTERACTION 


EFFECT SUCCESSES FAILURES TOTAL | 


HI B/HI D 12.190, KOS 29555 
LOW B/LOW D 









HI B/LOW D 
LOW B/HI D 


Q = 2.173+1.476+1.105+.750 = 5.504 


TABLE B-5: CD INTERACTION 


pm — 


EPFECT SUCCESSES FAILURES 


HI C/HI D 0-187 122472: 10.0985 244528 
LOW C/LOW D 





— 


HI C/LOW D 
LOW C/HI D 


Q = 187+.133+.095+.068 = 07433 
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APPENDIX C: ANOVA PROGRAM 


#include <stdio.h> 

#include <iostream.h> 

#include <math.h> 

#include <conio.h> 

#include <string.h> 
/* Function: factorial of a number */ 


double factorial(float start) 
{ 

float m=start; 

double Tl =m; 

ποτ ὃν τετ ο ο οτι το] 

while (m > 2.0) 


T1 *= (m-1); 
--m; 
} 
if (m==.5) 
return(0.8862269255); 
if (m==1,5) 
return(Tl * 0.8862269255); 
else 
return(T1); 


/* Function Fdistn * / 
double Fdistn(int Fl, int F2, float x) 


LEICA S., 

float M[70],N[70],Q[70]; 

Int iD El ΕΕ»): 

float A-0970 ε-ο ο σ-ο ο πσο ο κ-ο ο τ-ο,ο,  ὔξο, ο; 
C = x; 


if ((D[O] == 1.0) ¡¡ (D(1] == 1.0)) 
{ 
πε (πιο) ΟΠ ) 
H = D[ 1]; 
else 
R = DIOJ; 
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if (H>l) 


( 
if ((H%2) == 0.0) 
if (DIO]E-- 2.20 
os 
else 
S-2.0; 
ο ποτ ο, 
ο περ ι ος ιο ο ο 
C *= pow(-1.0 ; 
C += J; 
κ πο ο 7 20; 
ο... τ, 
{ 
μι) το οσα ο 
ο = (M(i]-1.0)/M[i]:; 
NO] ESOS 


FoOPO( 10750 K 919 ο τετ) 


M[i+1] *= M[i]; 
N[(i+1] = M(il; 


} 
N[K] = M(K-1]; 
for (1-0; i<- RK 91 


M[i] 15 

M[i] pow(C, M[i]); 
M[i] *= N[i]; 

T += M[i]; 


) 
τ «pon EO DE 04330 
T *= pow(-1.0,J); 
return(T+J); 

) 


else 


if (H == D[O]) 
S=2; 
else 
S=2; 
Ἱ pones DO ο το 
Josracan( Jd 
Kee rth =o 0) 7 260 
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if (S==1) 

B = Sin dJ); 

else 

Bicos d), 

tor (1-705 1<K; tti) 


{ 
Nea Pod sor el oo Xe: 
N[i] = pow(B,N[i]); 
MEETS MAMA AL ο) 

) 


RA IS "το 
M[i] *= M[i-1]; 


B = 1.0; 
LOL IL OSSLCK REL) 


BEES μι Ιστ] 
B = (B*cos(J)*sin(J)*pow(-1.0,5))+J; 
return(2.0*B/3.141592654); 
else 
return(1.0-(2.0xatan(1.0/(pow(C,0.5)))/3.141592654)); 
else 
í 
if (((D[0]%2) == 0.0) ¡¡ ((D[1]%2) == 0.0)) 
ee ο το O OS DAS 2 --ο ϱ)) 
( 
int (5[0] > D[1]) 
S=2. 
Er 
s=1.0; 
else 
KE A 0.0) 
sew 
2e 


S=2.0; 


} 
c= DOW 1,0,%5-1.0%)32712.0701.0+C%XD70]*1%,0/D!1]3)); 
€ += (S-1.0); 


>> 


PES ο 
Tos a 
else 
T mc 


BE 


(D[S-1] < 4.0) 


τρως αυ το ο 


else 


A = 


N[0] 


for 


( 
πιο πι 11 
B=1.0; 
Απο 2200/7205 
for (i=0; i<A; ++i) 
M[i] = 2.0*(i+l); 
A=(D[S-1)-4.0)/2.0; 
for (i=l; i<=A; ++i) 


for (i=0; i<=A; ++i) 


N[i] /= M[i]; 

M[i] = pow((1.0-C),M[i]/2.0); 
} 

for (1=0; 1<A; ++1) 

ΗΠ ο σας 

for (1-05, 1<-A τινα) 


M[i] *= N[i]; 
B *- M[i]; 


Z πι ο ρου δισ ο ο: 
552), 


[PowWl(1:0=22),B)*poun(z,(1.05B))), 
urale), 


Ρα 5 ο) 
= 1; 
(1200 19e mo BO] 


DR lo 
= M[iJ+L; 
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atan(pow((CxD[0])/D[1],0.5)); 
0 ο 


nur 
I 


0.0; 
or (i=0; i<=A; ++i) 
{ 


Mli] = (2% )+]; 

M[i] = pow(cos(T),M[i]); 
Mi MTI 

J += M[i]; 


((J*sin(T))*T)*2.0/3.141592654: 
Πο|5 ο) 

120; 

(1=0; i<B; ++i) 


— NR | Il ll << 


PS mS 
Πιν ΕΙ ο ο 


τος {1-0} d4«B. *t1) 


M[i*1] *- M[i]; 

N[i] = pow((sin(T)),N[i]); 
M[i] *= N[i]; 

Z += M(i]; 


(sin) )*pow(cos(t) DITI) 
factorial((D[1]-2)/2.0); 
1.0/K; 


ο 
’ 
. 


ctórial((B|1)=-1)/2,0); 


κι +1 << 


K 
fa 
K 


£ 


*= (2.0/(pow(3.141592654,0.5))); 
eturn(A-Z); 


/* Function Stu * / 
double STU(int d, float p) 


float z; 

z = Fdistn(l,d,(pow(p,2))); 

TEC DIO) 
return ((z+1)/2.0); 

else 
return(((=1.012)+1470)720); 
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/* Function NQUAN x / 
double Nquan(float p) 
{ 
Int M; 
float O=(p-0.5); 
float A1[4]-(2.5066282388, -18.615000625, 41.397197 77 73 
-25.4410604964}; 
float B1[4)=1-8.473510931, 23.0833674374, -21.06223410RBR8 
3.1308290983); 
float A2[4]=(-2.7871893114, -2.2979647913, 4.8501412714, 
273212127686}; 
float: B2[2]={(3.5438892476, 1.63706781897}; 
float- Ci4]=-{1,2;3,4}; 
float F[4]; 
float Eb:lb.056-:0.05T20. 0: 
if (fabs(Q) <= 0.42) 
{ 


e. 

Q=T*T; 

τος (ῃρ-ο κα τω) 

{ 
Elm) ροοίο οσα), 
Bl[ln] *= Fin]; 
E += Blin]; 
secs 
F[n]=pow(Q, C[n]); 
Aifa] Pin]: 
G += Alfl[n]; 


} 
τν ο ο Er) 
return(T)s 


) 


else 


Tspow(ftabstlog(0-5-(E3bs(oO))))4,0:5)7 
for (n 0:.n<e2 tn) 


Cin) = pew(T,(n+tl),; 
Cin] ΕΗ; 

Beta Cline 

} 


for (n=009<47 441) 
A2[n] *= pow(T,n); 


G += A2ln]; 
) 
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τν οςο) 
return(-1*G/E); 

else 
return(G/E); 


} 
} 
/* Function Tquan κκκΧ 


double Tquan(int d,float p) 
( 
Inters 
double z=0.0,x=0.0,DENS=0.0; 
183. 71=-0.0%5 72290024770 20592>9,07 
float τα δι -ίςσ ο ο ο οι: 
print£('"dz&$&d.WMn",&d); 
if (d==1.0) z=taní((p-0.5)*3.141592654); 


else 
if (d==2.0) 
IA LA) pom po) 
else 
x= eu 
TA[O] = 
TA[1] = (PALL + sala o0) de 


A [ 2 ] 
(x32 ο κ ρα ο 6) τς. "S 52700) $5. 0496.0)9* 
T A 3 


(xx-15.0/384.0)+((pow(x,3.0))x17.0/384.0)+((pow(x,5.0))x19.0 
13840) 
F (DONCX, T7. ο > ο 


A [ 4 ] 
(x*-945.0/92160. bate 3.0))/48.0)+((pow(x,5.0))*1482.0/ 
92160.0) 


+((pow(x,7.0))*776.0/92160.0)+((pow(x,9.0))*79.0/92160.0); 
for (n=0:n<5;++n) 


TA[n] *= pow(d, -n); 
z += TA[n]; 


} 
ifo(d>37.,0) 
y=2; 
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else 


TE (456.05 

aż 

else 

y=3; 

) 
PEs=>"d= LEG) 2805 
T2'=.(ds2.0)/2305 
Ti" Eacrorzal¢ ria: 
22 Sraetosrial 2): 

for (n l ns y, tin) 

1 

νη ὉΠ 
νο: ο. η; 
V2 = pow((d*3.141592654),0.5); 
DENS = T1/(T2*V1*V2)> 

z -= (STU(d,2)-p)/DENS; 

} 


Bet Wen iz): 


) 
AR 


Function Fquan  */ 


double Fquan(int dl, int d2, float p) 


( 


TIE CI BRZ 

tlcat A:0,0,B=0.0,N=0.0,SUM-0-.0 z=03207 
double L = 0.0; 

float U2]: 

BG Ed; 

DER KEE? 

DIOCODEO] 201) 4 P ED ==) 


( 
if (D[O] == 1) 
pel 
else 
Lz2507 
i£ (DIOJ < D{1]) 
A = D[1]; 
else 
A = D[O]; 
PONC L OCITO); 
ο ΕΕ Ρα 
Tquan(A,B); 
= aj 


t t DJ 09 


x "u om 
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το το 5) 
return(1.0/z); 
else 
return(z); 
else 


I pum -- 2) i: (D[1] == 2)) 
i (DONS DIL) 


lcs DEP 
es 
- 2 
N = ο 0 
A = ο[01» ΠΠ; 
if (A >= 1.0) 
{ 
B = Pp; 
ZE DLRI DEO) ROR EBEN NV CE CE BON Β Νο.” 
return z), 
} 
else 
{ 
BE RIO 
z = (D[1]/D[0])/((pow(B,N))/(1.0-pow(B,N))); 
return(z); 
) 
) 
else 
( 
A = Nquan(1.0-p); 
UO} 2=. 0 1451505 
ο Ἱ-- οι ο 
BER 1040) OOP IEBZU( 14) 
NEZ CZU LOW CZU EJ, 
Ls ρου ὃα 2050 007 
SUM = A*(pow(A,2)+11.0)/144.0; 
SUM *--(Bow((2.0/B),045)]%*bBbów(N, 2.0); 
SUM = ((5.0/6.0)-(B/3.0))+L-SUM; 
SUM *= N; 
z= ((p ος. O/B)+L),0.5))*A*B/2.0)-SUM; 
Z = exp(-2.0*z); 
SOBIE 
do 
{ 


SUM = (D[0]+D[1])/2.0; 
= pow(((zZz*D{O]/D[1])+1.0), SUM); 
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pow zza ΡΟ ο τι ο. 
L/SUM; 
D[0]*1.0/D[1]*1.0; 

=! pow  B, (D101) 2.0); 


Zr urr 
x un 


(faetorial( (DI%1]72.07-7.0))Faetor all DI 1172807 720905 
A = (factorial(((D[0]+D[1])/2.0)-1.0)/N)*L; 
z i-r aDOEdlistHoDIOs DI Ejouzo pA 
++]; 


) 
while (i<=3); 
return(z); 


void main() 


double test,anova; 

1nEd91,92,2,),k .8,1,DOEPr,DOFa,DOFD,ODEAINT ANZNUM: 

Ekcac"Ni > 200043 2327 

float x,y,p,q,Total,Total2,AÀve; 

float 55r,S8t,S5a,SSb,start,Fa,Fb,MSa,MSb.MSr:; 

printf("Welcome to the ANOVA procedure. If you are 
unfamiliar with\n"); 

printf( how ANOVA works, you should review its restrictions 
LIS ta 

printf('Make sure your data comes from normal 
distributions "EOP in^) 

printf("factorial problems, the data must be entered in 
standard order.\n"); 

printf("\n\nEnter (1) for One-way ANOVA\n"); 

printf("Enter (2) for Two-way ANOVA\n"); 

printf( Enter (3) for Faetorial ANOVA NN); 

scanf( %d',śopt); 

if (opt--1) 


{ 
SSt.- 35D: 
SSa = 0.0; 
num = 0; 


printf("Enter number of effects (limit 10)\n"); 
seanft πα ‚sınl); 

Total = 0.0; 

for (i-l i<-inl,tti) 


Sms cO 
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pranif( Enter number of data points Tor effect 
να "11; 
scanf("%d",&in2); 
printf("Press enter after each entry.\n"); 
Foral3-1,3)<-ı1n2, ++)7) 
{ 


scanf("$g",&x); 
SSt += pow(x,2); 
Total += x; 
numst= 1-0; 
s[i-1] += x; 


} 
osa += pow(Sf[i-1],2)/in2; 


} 

SSt = SSt - pow(Total,2)/num; 
SSa -= pow(Total,2)/num; 

SSb = SSt - SSa; 

DOFa ὑπ σετ, 


DOPE Sinum τας 

DOFb = DOFr - DOFa; 

printf( Enter significance level =- "y; 
fflush(stdin); 

scanf("%g", £p); 

Fa = (SSa/DOFa)/(SSb/DOFb); 

MSa = (SSa/DOFa); 

MSb = (SSb/DOFb); 


printf(" EFFECT SS DOF MS"); 
Printi F SIGNIF\n"); 

pEIDntt o cen m io a 
prince ο ο ρα ος πο, 

printf(" Between\n"); 

prin fO populations %g %d %g 


%g',SSa,DOFa,MSa,Fa); 
test=Fquan(DOFa,DOFb,p); 
if (test < Fa) 
Printer NEST E 
else 
DDIDnER NO\n"); 
printf("Residual %g $d 
%g\n",SSb,DOFb,MSb); 
Priner( Total %g πα. 551 ΠΟΕῈ}; 


} 
if (opt==2) 
{ 


eot -20.0> 
SSa = 0.0; 
SSD = 0.0; 
y = 0.0; 
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num = 0; 

printf('Enter number of effects (limit 10) mA 

scanf("%d",&inl); 

printf("Enter number of blocks (limit 10)\n"); 

scanf("%d",&in2) ; 

Total = 0.0; 

printf("Enter data by column. Press Enter after each 
pointoo n» 

fore(i=lsit=inl; FR) 


{ 
Total -99.0; 
for (j=1;j<=žin2;++j) 
{ 
scanf("%g",&x); 
ΠΠ Ια; 
Total += x; 
Y += x; 
num += 1.0; 
} 
N[i][in2+1] = Total/in2; 
) 
y /=num; 


for (j=l; J<=in2: tfj) 
{ 


N[inl * 1][j] = 0.0; 
for 171, i<=inl-+ti) 


{ 
N(inl * 1][j3] F: ΠΠ; 
SSt += pow( (NLiJ[ 7 70,296 


} 
N[inl + 1][j] /= inl; 
for (1=1;i<=in2;++1) 


if (i<=in1) SSa *-: pow PJ OSO ZJ 
SSb += pow((N[inl + 1][i] - y),2); 
) 

SSa *= in2; 

SSb *= in]; 

SSr = SSt - SSa - SSb; 

printf("Enter significance level: "); 

frlush(stdin): 

scant("%g", δρ); 

DOFa = inl - 1; 

DOBBD'= ANŻ 5 1; 


DOFr = DOFa*DOFb; 
Fa = (SSa/DOFa)/(SSr/DOFr); 
Fb = (SSb/DOFb)/(SSr/DOFr); 
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MSa = (SSa/DOFa); 

MSb = (SSb/DOFb); 

MSr = (SSr/DOFr); 

printf(" EFFECT SS DOF MS"); 
printf(" F SIGNIF\n"); 

printf(" ------ -- --- --"); 
printt(" =- ΓΓ---- AW); 

τε" Among\n"); 

printf( 'populations %g %d %g 


%g'',SSa,DOFa,MSa,Fa); 
test=Fquan(DOFa,DOFr,p); 
if (test < Fa) 


printe(" YES\n"); 
else 
printE(" NO\n"); 
printf("Blocks %g %d %g 


$g",SSb,DOFb,MSb,Fb); 
test-Fquan(DOFb,DOFr,p); 
if (test « Fb) 


printf(" YES\n"); 
else 
printi NO\n"); 
printf("Residual %g %d 
g\n",SSr,DOFr,MSr); 
DELNEG( Total %g %d\n",SSt,(num-1l)); 
else 
{ 


struct comp 


char name[6]; 
float sum; 


5525 
caro "A"; 
strepy(SS[0].name, strl); 
πα οἱ ερ ο Επ. 


strcpy(SS[1].name, str2); 
char *str3 = "AB“"; 
strepy(SS[2].name, str3); 


char *str4 = "c"; 
strcpy(SS[3].name, str4); 
char *str5 = "AC"; 
strcpy(SS[4].name, str5); 
Char “str6 = "BC"; 
strcpy(SS[5].name, str6); 
char ”str7 = "ABC"; 
strcpy(SS[6].name, str7); 
char *str8 = "D"; 


strcpy(SS[7].name, str8); 
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char συ ε = AD ; 
strcpy(SS[8].name, stry); 
char *strl0= "BD"; 
StrEPpy(55|3]) name, str lo); 
char str ΡΤ; 
śtrcpy(ssl1l0].name, stril); 
char *strl2 - "ABD"; 
strcpy(ss[11].name, str12); 
char *strl3 - "ACD'; 
strcpy(SS[12].name, str13); 
char strla BCD, 
strcpy(SS[13].name, str14); 
char *žstrl5 = "ABCD"; 
strcpy(SS[14].name, str15); 
char "Str UG 9 E 
strepy(SSI15)].name, strlo); 
char “strl? = Be | 
strcpy(SS[16].name, str17); 
char *strl8 - "BE'; 
strcpy(SS[17].name, str18); 
char kstrlo =- FCE"; 
strepy(SS[18].name, strl9); 
char *str20 = "DE"; 
strcpy(SS[19].name, str20); 
char *str2l = "ABE"; 
stropyos5]l20]-nasme  str21). 
char *str22 - "ACE'; 
SCTEBY(ESI21| name, Str22); 
char *ustros0- 4 αρα 

strepy sel22 Ik name, str23). 
char *str24 = "BCE"; 
strcpy(SS[23].name, str24); 
char *str>5c- BDB; 
strcpy(SS[24].name, str25); 
Ghar @strl60=- CDE? 
strepy(SS[25].name, str26); 
chars teo] o ABE, 
strcpy(SS[26].name, str27); 
char *str28 = "ABDE : 
strepy(SS[27].name, str28); 
char *str29 = "ACDE"; 
strepy(SS[28].name, str29); 
char *str30 = "BCDE"; 
strepy(SS[29].name, str30); 
char *str3l = "ABCDE ; 
strcpy(SS[30].name, str31); 
printf("Enter the number of effects: Ὁ); 
frlushlstdin > 

scant(' τα, ἀξ}; 
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bow(2.-kY-1- 


al = 0.0; 

printf('Enter the number of replications:  "); 
scanf('%d', δη); 

y = pow(2,k)*n; 

Sot 20.07 


printf("Enter data in standard order. Press enter\n"); 


printf("after each entry. in”) 
for (i=0;i<=l1l;+ti) 


ο τη 55020 
for (3.0 3<=(n=1)0++3) 


scanf("&g",&x); 
μυ er 
Total += N[i]l[lj]; 
S[1] += x; 

} 


} 
Ave = Total/(pow(2,k)*n); 
aues 

( 


Ss[0].sum = (1/y)*pow((S[1]+S[3]-S[0]-S[2]) 
SoL cumb sm bi Dow οι στ ο) 0 ο) 
5512] sum E ρου ES TO Ss e sis 123) 
for (1=0;i<=1;++1) 


2 
pee 
DOE 


+ 


for (j=0;j<=(n-1);++3) 


S5t += pow((N[1][3] - Ave),2); 


SSr = SSt - SS[0].sum - SS[1].sum - SS[2].sum; 
) 
if (k==3) 
( 


E EST u 

(1/7) *pow((5[11+5[3]+8[5]+s[7] Tu SIZE st4]- s161), 2). 
u 

ο ος TT ΕΞ 5[4]- st, : 
S u 

(1/9) *pos((St01+5[3]+8[4]48[7]- a SEN - s[5]- ste], 208 
S u m 

(1/y)*pow( (S[4]+S[5]+S[6]+S[7]- nE Sie Se) SESTO 
S S [ 4 ] s u m 
(1/y)*pow((S[0]+S[2]+S[5]+S[7]-S[1]-S[3]-S[4]-S[6]),2); 
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5-40 [ 5 ] : s u m = 
KLl/y)3#pout(s[o)#Ss[11+576]J+5[7)-S 21-573 -sfa] spp, 
S S [ 6 1 οσο. Ξ 
[1;Υ)ρομτ5 151 2}15|3 5755055515) 5157 τ 
for (1=0;1<=13++1) 


for (jJ=0;j<=(n-1);++j) 
SSt *- pow((N[i][j] - Ave),2); 


) 
SSr = SSt - SS[Oj.sum - SS[1].sum = "Ssf2] sun 
SS[3].sum - SS[4].sum 
- SS[5].sum - SS[6].sum; 


) 
if (k==4) 
( 


S S [ 0 ] i s u m = 
(1/y)*pow((S[1]+S[3]+S[5]+5[7]+S[9]+S[11]+S[13]+S[15] 
-S[0]-S[2]-S[4]-S[6]-S[8]-S[10]-S[12]-S[14]),2); 
S S [ al ] i c Em = 
(1l/y)*pow((S[2]+S[3]+S[6]+S[7]+S[10]+S[11]+S[14]+sS[15] 
-5[0]-S[1]-5[4]-8[53-5[8]-5[9]-5[ 127 SI 3er 
S [ 2 ] à S u m = 
(1/y)*pow((S[O]+S[3]+S[4]+S[7]+s[8]+S[11]+S5[12]+S[15] 
-S[1]-S[2]-S[5]-S[6]-S[9]-S[10]-S[13]-S[14]),2); 
S 5 [ 3 ] ; 5 u m = 
(l/y)*pow((S[4]+S[5]+S[6]+S[7]+S[12]+S[13]+S[14]+S[15] 
=S[0]-sS[1]-S[2]- S3 S18] S] STO] Sn 
S S [ 4 ] : S u m Ξ 
(1/y)*pow((S[0]+S[2]+S[5]+S[7]+S[8]+S[10]+S[13]+S[15] 
-S[1]-S[3]-S[4]-S[6]-S[9]-S[1l]- D UA 2 
S S [ 5 ] u 
(1/y)*pow((s[o]+s[1]+S[6]+s[7]+S[8]+S[9]+S[14]+S[15] 
-S[2]-S[3]-S[4]-S[5]- sL10]- s[11]-s(12]-S(13]), 2); 
S 5 [ 5 u m = 
O E ARON 
-5[0]-s[3]-s[5]-s[6]-s[8]-s[ı1]-s[ı13]-S[14]) ,2); 
5 5 [ 7 ] : S u m = 
(1/y)*pow((S[8]*S[9]*s[10]*S([11]*«s[12ji*Ss[13]*S[14]-*S[15] 
πο ο ο σε... ME m 5] L a 2 
S L u = 
ο ο ο μι ce ο ο. 
-S[1]-s[3]-s[5]-s[7]-s[8]-s[10]-s[12]-Ss[14])]),2):; 
S S [ 9 ] ; s u m - 
(1/y)*pow((S[0]+S[1]+5[4]+S[5]+S[10]+S[11]+S[14]+S[15] 
-S{2)-S[3]-S[6]-S[7]-S[8]-S[9]-S(12])-s[ lst PEE 
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"η. ] >. S u m Ξ 
(1/y)*pow((S[0]+S[1]+S[2]+S[3]+S[12]+S[13]+5[14]+S[15] 
τρ 22176] 5777-558 1-5091257107=-511177,2)5 
SS] . S u m = 
(1/y)*pow((S[1]1+S[2]+S[5]+S[6]+S[8]+S[11]+S[12]+S[15] 
-s[0]-S[3]-S[4]-S[7]-S[9]-S[10]-S[13]-S[14]),2); 
Saas EIL xs um = 
(1/y)*pow((S[1]+S[3]+S[4]+S[6]+S[8]+S[10]+S[13]+S[15] 
-S[0]-S[2]-S[5]-S[7]-S[9]-S[11]-S[12]-S[14]),2); 
Ss he eee ο ο Im E 
Ory) pom ο ο) στο | tS Si) esl sits o)+sf[il4]+s[i5] 
-S[(0]-S[1]-S[6]-S[7]-S[10]-S[11]-S[12]-S[13]),2); 
ον ο ee Wm = 
πιο]. Ππ5|5|55|5|55|10|115|12]15|15} 
-S[1]-S[2]-S[{4]-S[7]-S[8]-S[11]-S[13]-S[14]),2); 
tor ir20514-15 5:1) 


For (350.362 0mnsl) FRR.) 
( 
SSti+= Dow NAS Ave ολ. 


) 
SSr = SSt - SS[0].sum - SS[1].sum - SS[2].sum - 
SS[3].sum - SS[4].sum 
z=ss[5]2 sum = 755768 1 .5um > 58.7. sum = S5[8] sum = 
SS[9].sum 
ΓΙ] :π 551] sum SSII zum SE 
- SS[14].sum; 


) 
1f (k==5) 
{ 


S S O ] : Sc aem = 
(1/y)*pow((S[1]+S[3]+5[5]+S[7]+S[9]+S[11]+S[13]+S[15] 
+5S[17]+S[19]+S[21]+S[23]+S[25]+S[27]+sS[29]+S[ 31] 
-5[0]-S[2]-S[4]-S[6]-S[8]-S[10]-S[12]-S[14] 


-5[16]-S[18]-S[20]- Er om" EE SE28]=S[30]),2)7 
s u m = 
(1/y)*pou((5[2]+5[3]+S[6]+5[7]+S[10]+5[11]+S[14]+S[15] 
*S[18]*8[19]*8[22]*S[23]*S[26]*8[27]*85[30] *8[ 31] 
-S[0]-s[1]-Ss[4]-S[5]-s[8]-s[9]-s[12]-S[ 13] 
-5[16]-S[17]-S[20]-S[21]-S[24]-S[25]-S[28]-S[29]),2); 
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ον ANE v] = ΠΠ = 
(1/y)*pow((S[0]+S[3]+S[4]+S[7]+S[8]+S[11]+S[12]+S[15] 
+S[17]+S[19]+S[20]+S[23]+S[24]+S[27]+S[28]+S[31] 
-=S[1]-S[2]=s[5]-S[6]-S[9]-s[10]-s(13]=S[14] 
-S[16]-s[18]-s[21]-S[22]-S[25]-s[26]-S[29]-s[30]),2): 
S 5 [ 3 ] : s u m = 
(1/y)*pow((S[4]+S[5]+S[6]+S[7]+S[12]+S[13]+S[14]+S[15] 
+S5[20]+S[21]+S[22]+S[23]+S[28]+S[29]+S[30]+S[31] 
-S[0]-S[1]-S[2]-S[3]-S[8]-S[9]-S[10]-S[11] 
-5[16]-S[17]-S[18]-S[19]-S[24]-S[25]-S[26]-S[27]),2); 
UE t | =) ε.α. Mem = 
(1/y)*pow((S[0]+S[2]+S[5]+S[{7]+S[8]+S[10]+S[13]+S[15] 
+5[16]+S[18]+S[21]+S[23]+S[24]+S[26]+S[29]+S[31] 
-S[1]-S[3]-S[4]-S[6]-S[9]-S[11]-S[12]-S[14] 
-S5[17]-S[19]-S[20]-S[22]-S[25]-S[27]-S[28]-S[30]),2); 
S S owo mad . S u MM = 
(1/y)*pow((S[0]+S[1]+S[6]+S[7]+S[8]+S[9]+S[14]+S[15] 
+5[16]+5[17]+5[22]+S[ 23]+5[ 24]+35[ 25 J+5 [30 ] #3 ΠΝ 
-S[2]-s[3]-s[4]-s[5]-s[ı0o]-s[ı1]-s[12]-s[13] 
-S[18]-S[19]-S[20;-S[21]-S[26]-s[27]-S[28]-S[29]),2); 
S S [ 6 ] : S. um Ξ 
(Ay yo AAA τοι ES FE] RES DO ES lts as 
*S5[17]*S[18]*s[20]*S[23]*8[25]*S8S[26] *S[28 ] cS | IJ 
-S[0]-s([31-sf[5]-sf[5]-sí8]-s[1:i]-s[13]-s[14] 
-S[16]-s[19]-s[21]-s[22]-Ss[24]-s[27]-S5[29]-S[ 30] 2295 
ss [ 7 ] t s u m = 
(1/y)*pow((S[8]+S[(9]+S[10]+S[11]+S[(12]+5{13]+S[(14]|FS EJ 
+S[24]+S5S[25]+8[26]+S[27]+8[28;+S[29]+S[30 "SF S] 
-s[0]-S[1]-S[2]-S[3]-S[4)]-S[5]-S[6]-S[7] 
-S[16]-s[17]-s[18]-s[(19]-s[20]-s[21]-s[22]-s[23]),2); 
S S [ 8 ] ! S u mm - 
(l/y)*pow((s[0]+s[2]+s[4]+s[6]+s[9]+s[11]+s[13]+s[15] 
+s[16]+s[ı18]+s[20]+S[22]+S[25]J+S[L27]+S[29]J+S[ 31] 
-St1]-sf3]-s[5]-s[7]-s[8]-s[10]-s[12]-S[14] 
-S[17]-s[19]-s[21]-s[23]-s[24]-s[26]-s[28]-s[30]),2); 
S S Gee: η zc ES UM = 
(1/y)*pow((S[0]+S[1]+S[4]+S5[5]+S[10]+S[11]+S[14]+S[15] 
+5[16]+S[17]+5[20]+S[21]+S[26]+S[27]+S[30]+S[31] 
-S[2]-S[3]-5S[6]-S[7]-S[8]-S[9]-S[12]-S[13] 
-S[18]-S[19]-S[22]-S[23]-S[24]-S[25]-S[28]-S[29]),2); 
S S [ 1 ο | > is u m = 
(1/y)*pow((s[o]+s[1]+s[2]+s[3)]+s[12]+5[13]+s[14]+S[15] 
+5[16]+S[17]+S[18]+S[19]+S[28]+S[29]+S[30]+S[31] 
-5[4]-S[5]-S[6]-S[7]-S[8]-S[9]-S[10]-s[1l] 


-spoojesror]esp2?1-5[231-$S024 ] 91025) 5] 264] ο ο. EE 
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Sa ἡ IIS: σι = 
τον ο ES FEE SR ESKE ESS TESTE ESPE] FSTTS] 
+S[17]+S[18]+S[21]+s[22]+s[24]+s[27]+s[ 28)]+s[31] 
-S[0]-s[3]-s[4]-S[7]-s[9]-s[10]-s[13]-s[14] 


> u m = 
(1/y)*pow((S[1]+S[3]+S[4]+S[6]+S[8]+S[10]+S[13]+S[15] 
tom sesso Ssmo sss] s rs 
ECOSSE ES ο τη plo ior id) 


οἱ οἱ οἱ οἱ στο οἱ οι ο οι ο τι ο ο ο) δ.σ): 
CP ETE: Ὁ i 


-s[16]-s(18]-s(21]-Ss[23]-s[25]-s[27]-s[28]-S[30]),2); 
S S l1 3 ] ms u m = 
MY) DON GES ES FS AS PA ESP SES ES] EST 9 FS [14] STS] 
+s[18]+s[19]+s[20]+s[21]+s[24]+s[25j+S[30]+s[ 31] 
-S[0]-S[1]-S[6]-S[7]-S[10]-S{11]-S[12]-S[13] 


-S[16]-S[17]-S[22]-S[23]-S[26]-S[27]-Ss[28]-s[29]),2); 
S S Jn 1 4 NAS. u M = 
HS ρου isis le ο ο ο) οὗ 1ο] 1155] 
+5[16]+S[19]+S[21]+S[22]+S[25]+S[26]+S[28]+S[31] 
-S[1]-S[2]-S[4]-S[7]-S[8]-S[11]-S[13]-S[14] 


-S[17]-S[18]-S[20]- zo s[24]- ka s[29]-s[30]),2); 
S 5 u m = 
E IEEE ETNO RAN GE 


+5[23]+S[24]+S[25]+S[26]+S[27]+S[28]+S[29]+S[30]+S[31] 
-5[10]-S[1]-S[2]-S[3]-S[4]-S[5]-S[6]-S[7] 
-s[8]-S[9]-S[10]-S[11]-S[12]-S[13]-S[14]-S[15]),2); 
S S [ 1 6 ] MS u M = 
Moon SO Si ESLAS el Sie FS TO TFS] 2] FS ETA] 
+5[17]+s[19j+s[21]+s[23]+s[25]+s[27]+s[29]+s[ 31] 
-S[1]-S[3]-S[5]-S[7]-S[9]-S[11j-5[13]-S[15] 


-S[16]-S[18]-S[20]-S[22j]-S[24]-S[26]-S[28j]-S[30]),2); 
S S [ 1 7 ] 05: AUS AM = 
(1/y)*pow((S[0]+S[1]+S[4]+S[5]+S[8]+S[9]+S[12]+S[13] 
5187 +5 [129145] 2274572 3185[ 2815572 7]+5[ 30 ]#+87 37] 
-S[2]-S[3]-s[6]-SsS[7]-s[10]-S[11j]j-s[14]-S[15] 


-S[16]-s[17]-s[20]-s[21]-S[24]-s[25]-s[28]-s[29]7),2); 
S S [ 1 8 INR m = 
(1/y)*pow((S[0]+S[1]+S[2]+S[3]+S[8]+S[9]+S[10]+S[11] 
+S5[20]+S[21]+S[22]+S[23]+S[28]+S[29]+S[30]+S[31] 
-S[4]-s[5]-s[6]-s[7]-s[12]-s[13]-s[14]-s[15] 


ao ο ο πο ο οὗ ο οι ο 512) ο) στ] 2): 
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S S [ 1 9 J] DS UU 
τν σροµς 59ης] οποια ο) SIE] 
+S[24]+S[25]+S[26]+S[27]+S[28]+S[29]+S[30]+S[31] 
=S[8 ]-S{(9]-S[10]J-S[1I] -S12 ]- Sí] SiM] οτι 


=5[16]-5Sf17]-s[f1e]-s[13]-sSs[2959 5722] -Sf 227 SI 7 223 
SSS ο D ii ών S u m 
(1/y)*pow((s[1]+S[2]+S[5]+S[6]+S[9]+S[10]+S[13]+S[14] 
+S[16]+sS[19]J+S[20]+8[23]+5[24]+S8[27]+5[28 7] +5 15M 
-=5[0]-513]-5F47-8S]71]-5[8]-57 117 Sf P] sS rE] 


-S[17]-s[18]-s[21]-s[22]-s[25]-s[26]-s[29]-s[30]),2) 
S S I 20521 ον ZAM 
(1/y)*pow((S[1]+S[3]+S[4]+S[6]+S[9]+S[11]+S[12]+S[14) 
+5[16]+S[18]+S[21]+S[23]+S[24]+S[26]+S[29]+S[31] 
-S[0]-S[2]-S[5]-S[7]-S[8]-S[10]-S[13]-5[15] 


-S[17]-S[19]-S[20]- st22]- 2er 5127) st231-587307)7 205 

[ 2 1 s u m 

pta ion iia ae -S(12] 1-5] 13) 
+s{16]2+S118143120]+3[22]+s[25]+5[37]+8[29]+ef31] 

=s(07-.5[ 27. S5f37- s[fejestsj sta ste. 7 1 


-5[17]-s[19]-s[21]- ea Pn D S128 ]-ST30 I 2); 
[ ] s um 
ο ο a or OKONIE 
*tS[16]*S[17]*8[22]*8S[23]*8[24]*S[25]*8[30] *S[ 31] 
-S[0]-s[1i1]-S[6]-s[7]-S[8]-S[9]-S[14]-S[ 15] 


-S[18]-S[19]-S[20]- E S[26]- o s[28]-s[29]),2); 
sau ] 32.2 5s) “a in 
ο ορ ο ed EL ME 
+5[16]+S[17]+S[20]+S[21]+S[26]+S[27]+S[30]+S[31] 
-S[0]-s[1]-S[4]-S[5]-s[10]-S[11]-S[14]-S[15] 


=87 18 |-5519]-5[/ 227. 5723, 537221775722 7573). 57 22220772 
S S 27 το ] M dS IS 
(1/y)*pow((S[4]*S[5]*«S[6]*s[7]*s[8]*S[9]*S[10]*5S/11] 
+S[16]+s[ı17]+s[ı8]+s!19]+s[28]+si29]+s[30]+s[ 31] 
-S[0]-S[1]-S[2]-S[3]-8[12]-8{13j-S[14j-S[15] 


-S[20]-Ss[21]-s[22]-S[23]-s[24]-S[25]-s[26]-s[f[27]),2); 
S. 5 T 276.1 . S u m 
(1/y)*pow((S[0]+S[3]+S[5]+S[6]+S[8]+S[11]+S[13]+S[14] 
+S5[17]+S[18]+S[20]+S[23]+S[25]+S[26]+S[29]+S[31] 
-S[1]-S[2]-S[4]-S[7]-S[9]-S[10]-S[12]-S[15] 


Sf 16] 57197-5021]257227 5722] 5f27, 527 sp 2 22 
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ΞΕ ΤΙ τ. um 

(1/y)*pow((S[O0]+S[3]tS[4]+S[7]+5[9]+S[10]+S[13]+S5[14] 
+S[17]+s[18]+s[21]+S[22]+s[24]+S[27]+S[28]+s[31] 

Soe) οἱ αι τι ο ο) ο) 1 δι 1-55] 


-5δ[16]-5[19]-5[20]- η zc ; S[29]-S[30]),2); 

S u m 

κ ο ο ο ο ο IST D 
+S[17]+S[19]+S[20]+ts[22]+s[24]ts[26]+s[29]+s[ 31] 

-S[1]-Ss[3]-s[4]-s[6]-s[8]-s[10]-s[13]-s(15] 


ec) 20 )-s(16)-s[18)]-si21]-=s[23}-si[251-si[ 27 ]-s[28])~2): 
ΠΠ; s um 
(l/y)*pow((S[0]+S[1]+S[6]+S[7]+S[10]+S[11]+S[12]+S[13] 
+S[18]+S[19]+S[20]+S[21]+S[24]+S[25]+S[30]+S[31] 
-512]-5[3]-5[4]-S[5]-S[8]-S[9]-S[14]-S[15] 


spreszs[l17]-822325[.23)25[26]-5[ 277] -5[28]-5[23]),2): 

SM oS MESE es ul m 

(1/y)*pow((S[1]+S[2]+s[4]J+s[7]+s[8sj]+s[ı1]+s[ı3]+S[14] 
+5[16]+5[19]+5[21]+S[22]+S[25j+S[26]+S[28]+S[31] 

ο ο SS] ο δυο ο ο σοι. Ἱ-δι15] 


-s[17]-s[18]-s[20]-s[23]-s[24]-s[27]-s[29]-s[30]),2): 
tor (1=0;1<=1;++i1) 
οι ο πες NEL HET) 
{ 
ο Ρο Ντ Ave), 2); 

) 

Sob FS St. 

for (i=-0;i<=30;++i) 


SSr -= SS[i].sum; 


} 
ΕΙ IV e 


if (DOFr==0) DOFr=1; 

printf( Enter significance level: "); 

fflrush(stdin)., 

scanf ("%g", &p); 

test-Fquan(1,DOFr,p); 

PEJNEG( ERBECH 59 DORF MS 
SIGNIE\n ): 

printf("------ -- --- -- 


Su 


for (1=0; i«(pow(2,k)-1);**i) 


q=SS[i].sum/(SSr/DOFr): 

printf("%s 
$g",SS[i].name,SS[i].sum, 

ss[il].sum,q); 

if (test<=q) 


printf(" YES\n"); 
else 
printf(" NOW"); 


) 


y WY 


%g 


%g 
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